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Abstract 



The important and sometimes difficult-to-grasp concept of regression suppressor variable 
effects is explored. An inquiry into the phenomenon of suppressor effects is accomplished 
via a synthesis of the existing literature and the use of a small heuristic data set to improve 
the accessibility of the concept. Implications for researchers are also forwarded and it is 
argued that the search for suppressor variables in an effort to remove unwanted predictor 
variable variance may prove less efBcient than the search for additional predictor variables 
which directly explain variance in the criterion variable of interest. However, when they 
are present, suppressor effects can be critical to note and interpret. 



The author wishes to thank Bruce Thompson for his comments on an earlier version of this 
manuscript. 
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It is generally understood that the ‘usefulness’ of a given predictor variable can be 
measured by the impact that it has on explaining the variance in a respective criterion, or 
dependent, variable. What may be overlooked, however, is a second way in which a 
predictor variable can impact predictability— namely, through increasing the predictive 
power of other predictor, or independent, variables. This phenomenon, termed 
suppression, was first forwarded by Horst (1941) who claimed that suppression resulted 
fi'om the inclusion (in a regression equation) of a predictor variable having a zero or near- 
zero correlation with the criterion variable while being correlated with at least one other 
predictor variable. 

The format and intent of this manuscript is threefold. First, a synthesis of existing 
literature concerning suppressor effects is pursued with the intent of providing the reader 
with a basic primer on the topic. Second, a heuristic data set that illustrates the various 
dimensions of the phenomenon is presented. Finally, a discussion as to the relevance of 
investigating the topic of suppressor effects is forwarded noting some advantages and 
pitfalls which are likely to be encountered in applied research. 

CONCEPTUAL DEVELOPMENT 

Classical Definition 

In what has become known as the classical definition of a suppressor variable, 
Horst (1966, p. 3SS) relayed an experience in the prediction of success in pilot training 
programs during World War II. Comprising the examination battery given to prospective 
pilots were tests of mechanical, numerical, spatial and verbal ability. Each of the first 
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three predictor variables had positive correlations with the criterion variable, success as a 
pilot. The fourth, verbal ability, was virtually uncorrelated with pilot success yet had a 
fairly high correlation with each of the other three predictors. An interesting finding was 
that when verbal ability was included as a variable in the regression equation, the ^ of the 
model as a whole increased despite the near-zero r between verbal ability and pilot training 
success. 

Horst concluded that while verbal ability was not a noteworthy predictor of pilot 
success, verbal ability indirectly improved the prediction by making the other predictor 
variables purer measures and thus, improved their predictive power. Simply put, 
measurement artifacts contaminated the results (Thompson, 1992). By removing 
(suppressing) the variance accounted for by verbal ability fi’om the equation, the predictive 
efficiency of the remaining variables was improved. 

INSERT FIGURE 1 ABOUT HERE 

Figure 1 provides a graphical illustration of how a classical suppressor variable 
operates. Xp represents the first predictor variable. Notice that the correlation between 
the suppressor variable (X.) and Y is zero while a correlation does exist between Xp and 
X,. This relationship necessarily implies that the structure coefficient (Thompson, 1997; 
Thompson & Borrello, 1985) equals zero while the r between predictor variables is non- 
zero. The suppressor variable impacts the criterion variable primarily through its impact 
on the beta weight of the other predictor variable. 
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Expanded Definitions 

Central to the Horst (1941, 1966) definition is the existence of a near-zero 
structure coefficient and a non-zero beta coefficient. In fact, perfect prediction would 
result if X. explains all of the ‘remaining’ variance in Xp (Smith et al., 1992). In essence, 

r^ Y.xp.xi = 1 - r^ Y.xp 

It is a purely theoretical exercise to contemplate a situation in which the 
suppressor variable will have exactly a zero correlation with the criterion variable. 
Darlington (1968) forwarded a more general definition of a suppressor by defining it as a 
variable which, if included in a set of predictors which are positively correlated with the 
dependent variable, receives a negative regression coefficient when regressed on the 
population of variables. By introducing the concept of “population”, Darlington averted 
the issue of sampling error (Conger, 1974). This classification is termed negative 
suppression (due to the negative value of the coefficient), yet the fundamental behavior of 
the variable acts just as it does under the Horst (1941) definition, notably, by increasing 
predictive power of regression variables through the removal of irrelevant variance in 
other predictor variables. 

The preceding definitions of the suppressor effect are based primarily upon 
examination of the suppressor beta weights and zero-order correlations. What had been 
absent in the study of suppressors was the impact that each suppressor variable’s beta 
weight had on the beta of the other predictor variable(s). 

Taking this logic further, a suppressor variable is not uniquely defined by its own 
beta weight but rather through its impact on the weights given to the other predictor 
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variables (Conger, 1974). It should be reiterated here that beta weights are impacted by 
correlations among the various predictors and may therefore change in value if the 
correlations or the predictors change (Thompson, 1992). Beta weights should not be 
interpreted as constants when they are clearly context specific. 

Conger (1974) discovered that for both classical and negative suppressor 
variables, the regression weights of the suppressed (Xp) variables are increased with the 
addition of the suppressor variable (X,). According to Conger (1974, p. 36), a suppressor 
variable is defined as “a variable which increases the predictive validity of another variable 
(or set of variables) by its inclusion in the regression equation. This variable is a 
suppressor only for those variables whose regression weights are increased.” 

This definition, termed reciprocal suppression, subsumes all previous typologies 
while expanding the application beyond mere two-variable equations to the k-variable 
case. Thus, a suppressor variable is identifiable by its impact on the beta weights of other 
independent variables in the regression system rather than merely by its own weight. 

HEURISTIC EXAMPLE 

To this point, the purpose of this manuscript has been to familiarize the reader with 
the conceptual development of the suppressor effect in the hope of providing a foundation 
upon which to build a knowledge base. An examination into the dynamics of each of the 
three recognized types of suppressors should now prove more beneficial. Let us first 
consider a bivariate regression equation where Y is regressed on Xi: 

(1) Yhat = a + fiiXi 



O 

ERIC 



5 



7 



BEST COPY AVAILABLE 



Invoking the classical suppressor definition, the addition of a second variable, X2, into the 
equation would traditionally have a structure coefficient Tyxi = 0 a non-zero beta 
value. The introduction of X2 suppresses the irrelevant variance in Xi thereby increasing 
the of the multiple regression equation. Due to its impact on the predictive power of 
the equation, X2 will receive a beta coefficient despite its lack of correlation with the 
criterion variable, Y. The resulting equation will be in the form 

( 2 ) YhatcLASSICAL ~ S fiiXi + 62^2 

where 1^2 is not equal to zero and and 1^2 have opposite signs. 

Assuming the negative suppression definition, X2 is positively correlated with the 
dependent variable Y yet receives an unanticipated negative beta coefficient value. The 
equation for negative suppression, 

( 3 ) YhatNEOATTVB ~ 3 + fiiXi + 62X2 , 

resembles equation ( 2 ) with the caveats that under negative suppression, 1^2 < 0 and the 
structure coefficient, ry,x2 > 0 . 

In the reciprocal suppressor circumstance, the regression equation will be similar 
to equations ( 2 ) and ( 3 ) but with some key differences. First, X2 will be positively 
correlated with Y and will receive a positive beta coefficient. Secondly, X2 will be 
correlated with Xi and the addition of X2 into the regression equation leads to an increase 
in the value of i^i over what it would have been had X2 not entered the equation in 
addition to an increase in 1^2 over what it would have been if X2 were entered as the sole 
predictor variable. Thus, 

( 4 ) YhatsBCIFROCAL ~ 3 fiiXi >62X2 
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where li2 ^ 0 > ^1 reciprocal ^ iii yhat ind li2 reciprocal^ ^2 YHAT- This interesting dynsmic 
arises when the two independent variables, Xi and X 2 , mutually suppress irrelevant 
variance in each other (Conger, 1974; Lutz, 1983). 

Table 1 is a simple heuristic data set developed by Lutz (1983) which is useful in 

facilitating an understanding of the phenomenon by highlighting all three suppressor effect 

types. The variable definitions utilized in the table are; 

Y Criterion Variable Score 

Xi 1st Predictor Variable Score 

X 2 C Classical Suppressor Variable Score 

X 2 N Negative Suppressor Variable Score 

X 2 R Reciprocal Suppressor Variable Score 

INSERT TABLE 1 ABOUT HERE 



From Table 2, we see the inter-variable simple correlations. Only those 
relationships of interest to our study have their values listed. Notice that the structure 
coefficients for each of the X 2 variables satisfies the definitional characteristics set forth in 
the preceding pages. X 2 C has a zero correlation with Y ( r = 0.00) and a positive 
correlation with Xi. Likewise, X 2 N has a positive correlation with both Y and Xi while 
r YX 2 R = 0.46 yet is negatively correlated with Xi in the reciprocal case. 



INSERT TABLE 2 ABOUT HERE 

Finally, by regressing the criterion values against the respective predictor values 
one obtains the standardized regression coefficients detailed in Table 3. Notice that for 
each of the three suppressor types, the beta coefficient for Xi is increased over what it 



7 



9 best COPY AVAILABLE 



would have been had no additional independent variable been introduced. The beta for 
Xi, assuming no additional predictors, would have simply been the zero-order correlation 
between Y and Xi given in Table 2. 

INSERT TABLE 3 ABOUT HERE 

In the classical example, X 2 C has a structure coefficient of zero and a non-zero 
beta. Also true to form, the negative suppressor type has a positive structure coefficient 
and a negative beta while the negative relationship between X 2 R and Xi coupled with the 
positive correlation between X 2 R and Y produce the definitive reciprocal suppressor 
effect. This small data set was designed to facilitate an understanding of the various effect 
types. Empirical investigations of suppressor effects broach topics ranging fi-om the 
relationship between shyness and alcohol consumption (Bruch et al., 1992) to the 
association between goal orientation and task performance (Hofinann, 1993) and can 
provide the reader with a more complete understanding of the effect. 

IMPLICATIONS FOR RESEARCHERS 

Given the previous discussion, at least two implications of suppressor effects 
emerge as potentially important issues for researchers using regression methods. On an 
interpretation level, given that a suppressor variable does not require modification of the 
basic regression model, a practical problem is that suppressor variables may simply be 
overlooked because of their low zero-order correlations (Velicer, 1978) or seemingly 
counter-productive beta weights. 
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From an experimental validity level, the researcher might even question whether 
or not the pursuit of suppressors is worthwhile. Conger and Jackson (1972, p. 597) 
claimed that “a suppressor for any given degree of correlation does not yield as much 
incremental validity as an additional predictor.” The question then becomes ‘what 
strategy regarding predictor variables will yield the greatest reward in the explanation of 
variance?’ 

Thompson (1992) stated that interpreting beta weights alone is insufGcient in 
analyzing regression results and that further analysis, such as examination of structure 
coefBcients or simple correlations, is necessary if conducting a thorough examination. 
Evaluation of the structure coefBcients or correlation of the criterion-predictor variables 
will lead to identical conclusions (Pedhazur, 1982; Thompson, 1992) given that they are 
merely expressed in a different metric. 

Given the classical suppressor example values from Tables 1 and 2, a less 
thoughtful researcher may incorrectly assume that X 2 C provides nothing in the form of 
predictive power if they simply looked at either the B = -1.00 or the r y.xic = 0.00. 
Likewise, a cursory examination of results from a reciprocal effect situation may lead to 
inaccurate interpretation when both independent variables mutually benefit from each 
others presence and removal of either one would diminish the predictive power of the 
regression equation. 

As to the incremental validity question. Conger and Jackson (1972)^ warn that 
researchers should not expect to find suppressor-predictor r’s to be much larger than the 
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criterion-predictor r. A problem frequently arises when large suppressor-predictor 
correlations are necessary to increase the explanatory power of a set of variables. For 
example, to increase the R of a regression equation from 0.40 to 0.50, a suppressor 
variable with rxi.x 2 == 0.60 is required. This is no small requirement. 

This leads to the belief that it may be more beneficial for the researcher to focus 
on uncovering additional predictor variables which explain variance in the criterion 
variable rather than seeking suppressor variables. Assuming the researcher is not ‘data 
mining’ and has developed a thoughtful theoretical rationale for their experimental design, 
it makes intuitive sense that meaningful predictor variables would be identified in the 
literature review phase of the research. 

That is not to say that suppressor effects should not be considered when they 
occur. A thorough scrutiny of all relevant variables is expected of a thorough researcher. 
It is through this scrutiny of both beta coefficients and structure coefficients that the 
suppressor effect will likely be uncovered and correct interpretations will be formulated. 
The point, however, is that efforts to increase the predictive power of an experiment may 
be better served by a sound conceptual development which uncovers noteworthy predictor 
variables. More may be gmed from the discovery of that portion of the criterion variable 
which is not being predicted than that part of the predictor variable not bring used 
(Conger & Jackson, 1972). 

The suppressor variable effect, while empirically rare, provides an opportunity to 
reiterate the necessity for the researcher to thoroughly analyze and interpret experimental 
results. Cursory data examination can lead to the dismissal of important variables as well 
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as an incorrect interpretation of system effects. An understanding of suppressor effects in 
regression analyses can lead to a more complete interpretation of the phenomena under 
investigation by alerting the researcher to potential areas of insight unseen by less 
thorough peers. 
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Table 1 
Data Set 



id 


Y 


X, 


X2C 


XiN 


X2R 


1 


-1.5 


-0.3 


0.9 


0.2 


-0.3 


2 


-1.0 


-0.8 


-0.6 


-0.3 


0.0 


3 


-0.5 


-0.9 


-1.4 


-0.6 


0.2 


4 


0.0 


-0.3 


-0.6 


-0.2 


0.1 


5 


0.0 


0.3 


0.6 


0.2 


-0.1 


6 


0.5 


0.9 


1.4 


0.6 


-0.2 


7 


1.0 


0.8 


0.6 


0.3 


0.0 


8 


1.5 


0.3 


-0.9 


-0.2 


0.3 



Table 2 

Bivariate Correlations 





Y 


X, 


X2C 


XiN 


X2R 


Y 


— 


0.70 


0.00 


0.23 


0.46 


X, 

X2C 

X2N 

XlR 






0.70 


0.85 


-0.31 



Table 3 

Regression Beta Weights 



Suppressor Type 


fii 


fii 


Classical (Xjc) 


1.40 


-1.00 


Negative (Xin) 


1.87 


-1.37 


Reciprocal (X 2 r) 


0.94 


0.75 
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Figure 1 

Venn Diagram of Elements of a Suppressor Relationship 
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